The Air Force Studies Board of the National Academies of Sciences, Engineering, and Medicine hosted a three-part workshop series to examine the risks associated with the technical, programmatic, organizational, and governance challenges facing the Department of the Air Force (DAF) in its pursuit of enterprise-wide digital transformation strategies. Senior representatives from government, military, industry, and academia considered the DAF's strategic-level decision-making process as well as how it could achieve unity of effort across all of its digital agencies. Workshop participants discussed organizational and management gaps and weaknesses, as well as technical shortfalls associated with the DAF's digital transformation strategies - for example, the issue of cybersecurity within the context of the DAF's proposed digital strategies. Organizational and management practices from both the public and private sectors were also discussed in light of their potential for adaptation and adoption within the DAF. Sponsored by the U.S. Department of Defense, the three 2-day workshops of the series were held virtually on September 1-2, 2021, September 8-9, 2021, and September 23-24. Panelists at the first workshop explained and discussed the DAF's digital transformation strategy - in particular, the proposed digital architectures and the systems, programs, organizations, and missions to be supported. The second workshop featured panels of information systems experts and managers from industry and other government agencies who discussed their experiences with digital transformations and shared their views of best practices. The third workshop focused on the potential applicability of these lessons learned to the DAF's digital transformation strategy and architecture. This proceedings is a factual summary of what occurred during the workshop series. Table of Contents Front Matter Introduction 1 Workshop One, Part One 2 Workshop One, Part Two 3 Workshop Two, Part One 4 Workshop Two, Part Two 5 Workshop Three, Part One 6 Workshop Three, Part Two Appendixes Appendix A: Statement of Task Appendix B: Workshop Agendas Appendix C: Biographical Information for Planning Committee Members Appendix D: Chief of Staff of the Air Force Strategic Studies Group Project and Study Ideas Appendix E: Workshop Series Recap Meeting

The Air Force Studies Board of the National Academies of Sciences, Engineering, and Medicine hosted a three-part workshop series to investigate the changing paradigm of time and knowledge in modern-day warfare. Sponsored by the U.S. Department of Defense, three 2-day workshops were held virtually on September 16-17, 2020, September 23-24, 2020, and October 1-2, 2020. The objective of the first workshop was to explore the ways in which the U.S. Air Force (USAF) has adjusted its capabilities in response to past shifts in operational timing. In consideration of these past shifts, the second workshop aimed to consider when there could be an advantage to synchronize or desynchronize rates of change with adversaries. Participants had the opportunity to discuss lessons learned and possible changes for USAF Doctrine and future operations. The goal of the third workshop was to examine the implications to doctrine, concepts of operations, and command and control from the recent acceleration of battlespace operations, arising from wide-scale digitization, large-scale sensing, and faster technologies. In all three workshops, speakers explored the broader issues surrounding changing environments, and participants discussed ways to adapt to fundamental changes in the time constants of conflict. This proceedings is a factual summary of what occurred during the workshop series. Table of Contents Front Matter Introduction 1 Workshop One, Part One 2 Workshop One, Part Two 3 Workshop Two, Part One 4 Workshop Two, Part Two 5 Workshop Three, Part One 6 Workshop Three, Part Two Appendixes Appendix A: Statement of Task Appendix B: Workshop Agendas Appendix C: Biographical Information for Planning Committee Members Appendix D: Uncertainty, Stability, Instability, Military Affairs, and Time: Some Thoughts and Conjectures Appendix E: Thoughts and Reactions to Planning Committee Discussions Appendix F: E-Mail Commentary on Workshops One and Two Appendix G: Workshop Series Recap Meeting

Structural racism refers to the public and private policies, institutional practices, norms, and cultural representations that inherently create unequal freedom, opportunity, value, resources, advantage, restrictions, constraints, or disadvantage for individuals and populations according to their race and ethnicity both across the life course and between generations. Developing a research agenda on structural racism includes consideration of the historical and contemporary policies and other structural factors that explicitly or implicitly affect the health and well-being of individuals, families, and communities, as well as strategies to measure those factors. The Committee on Population of the National Academies of Sciences, Engineering, and Medicine convened a 2-day public workshop on May 16-17, 2022, to identify and discuss the mechanisms through which structural racism operates, with a particular emphasis on health and well-being; to develop an agenda for future research and data collection on structural racism; and to strengthen the evidence base for policy making. Speaker presentations and workshop discussions provided insights into known sources of structural racism and rigorous models of health inequity, revealed novel sources and approaches informed by other disciplines and related fields, and highlighted key research and data priorities for future work on structural racism and health inequity. Table of Contents Front Matter Introduction 1 Setting the Foundation: Studying Race and Structural Racism Responsibly 2 Assessing the Landscape: The Measurement and Modeling of Structural Racism 3 Moving Forward: Data Infrastructure Needs in Harnessing Data for Research in Structural Racism 4 Key Takeaways References Appendix A: Workshop Agenda Appendix B: Biographical Information for Workshop Presenters and Discussants

Biomedical research data sets are becoming larger and more complex, and computing capabilities are expanding to enable transformative scientific results. The National Institutes of Health's (NIH's) National Library of Medicine (NLM) has the unique role of ensuring that biomedical research data are findable, accessible, interoperable, and reusable in an ethical manner. Tools that forecast the costs of long-term data preservation could be useful as the cost to curate and manage these data in meaningful ways continues to increase, as could stewardship to assess and maintain data that have future value. The National Academies of Sciences, Engineering, and Medicine convened a workshop on July 11-12, 2019 to gather insight and information in order to develop and demonstrate a framework for forecasting long-term costs for preserving, archiving, and accessing biomedical data. Presenters and attendees discussed tools and practices that NLM could use to help researchers and funders better integrate risk management practices and considerations into data preservation, archiving, and accessing decisions; methods to encourage NIH-funded researchers to consider, update, and track lifetime data; and burdens on the academic researchers and industry staff to implement these tools, methods, and practices. This publication summarizes the presentations and discussion of the workshop. Table of Contents Front Matter 1 Introduction 2 Data Sharing and Data Preservation 3 Data Risks and Costs 4 Tools and Practices for Risk Management, Data Preservation, and Accessing Decisions 5 Lifetime Data Costs 6 Reflections and Next Steps References Appendixes Appendix A: Workshop Agenda Appendix B: Biographical Sketches of Committee Appendix C: Registered In-Person Workshop Participants

While the public is generally aware of the use of hydraulic fracturing for unconventional resource development onshore, it is less familiar with the well completion and stimulation technologies used in offshore operations, including hydraulic fracturing, gravel packs, "fracpacks," and acid stimulation. Just as onshore technologies have improved, these well completion and stimulation technologies for offshore hydrocarbon resource development have progressed over many decades. To increase public understanding of these technologies, the National Academies of Sciences, Engineering, and Medicine established a planning committee to organize and convene a workshop on Offshore Well Completion and Stimulation: Using Hydraulic Fracturing and Other Technologies on October 2-3, 2017, in Washington, DC. This workshop examined the unique features about operating in the U.S. offshore environment, including well completion and stimulation technologies, environmental considerations and concerns, and health and safety management. Participants from across government, industry, academia, and nonprofit sectors shared their perspectives on operational and regulatory approaches to mitigating risks to the environment and to humans in the development of offshore resources. This publication summarizes the presentations and discussions from the workshop. Table of Contents Front Matter 1 Introduction 2 Advanced Technologies for Offshore Oil and Gas Development: Resource Recovery, Environmental Stewardship, and Safety 3 Offshore Oil and Gas Development 101 4 Offshore Technologies in Practice 5 Safety in the Offshore Environment 6 Environmental Considerations, Advanced Technologies, and Solutions References Appendix A: Workshop Agenda Appendix B: Members of the Roundtable on Unconventional Hydrocarbon Development Appendix C: Biographies of the Workshop Planning Committee Appendix D: Biographies of the Workshop Moderators and Presenters Appendix E: Workshop Participants Appendix F: Glossary

Measuring and analyzing public opinion comes with tremendous challenges, as evidenced by recent struggles to predict election outcomes and to anticipate mass mobilizations. The National Academies of Sciences, Engineering, and Medicine publication Measurement and Analysis of Public Opinion: An Analytic Framework presents in-depth information from experts on how to collect and glean insights from public opinion data, particularly in conditions where contextual issues call for applying caveats to those data. The Analytic Framework is designed specifically to help intelligence community analysts apply insights from the social and behavioral sciences on state-of-the-art approaches to analyze public attitudes in non- Western populations. Sponsored by the intelligence community, the National Academies? Board on Behavioral, Cognitive, and Sensory Sciences hosted a 2-day hybrid workshop on March 8?9, 2022, to present the Analytic Framework and to demonstrate its application across a series of hypothetical scenarios that might arise for an intelligence analyst tasked with summarizing public attitudes to inform a policy decision. Workshop participants explored cutting-edge methods for using large-scale data as well as cultural and ethical considerations for the collection and use of public opinion data. This publication summarizes the presentations and discussions of the workshop. Table of Contents Front Matter Introduction 1 Public Opinion Data and the Analytic Framework 2 Hypothetical Applications of the Analytic Framework 3 Lessons Learned and Future Pathways References Appendix A: Workshop Agenda Appendix B: Biographical Information for Workshop Participants

The Defense Materials Manufacturing and Infrastructure standing and planning committee of the National Academies of Sciences, Engineering, and Medicine convened a workshop on May 19-20, 2016, to discuss the value of collaboration between the materials and civil engineering communities in addressing the following problem: People and equipment are continuously monitored through multiple organizations and instruments, but the physical infrastructure where they live, train, and deploy receives little attention until it fails or is shown to be inadequate. The workshop was organized into three sessions: (1) highway infrastructure, (2) waterways infrastructure, and (3) railways infrastructure. Within these three sessions, individual speakers gave presentations on technical, functional, and economic paradigms and answered questions from workshop participants. Following these sessions, a panel discussion was held to discuss existing gaps as well as ways to overcome challenges. This publication summarizes the presentations and discussion of the workshop. Table of Contents Front Matter 1 Introduction 2 Keynote Address 3 Highway Infrastructure 4 Waterways Infrastructure 5 Railways Infrastructure 6 Panel Discussion and Wrap-Up Appendixes Appendix A: Workshop Statement of Task Appendix B: Workshop Agenda and Participants List Appendix C: Acronyms

High-entropy materials, ultra-strong molecules, and nanoelectronics have become a focus of active research because of their unique potential and applications. Global research is rapidly accelerating and unlocking major recent breakthroughs. It is important to highlight these recent developments and explore possibilities for future research and applications. The National Academies convened a workshop on February 10-11, 2016 to discuss issues in defense materials, manufacturing, and infrastructure. Key topics of discussion included emerging capabilities and research objectives for ultra-strong molecules, high-entropy materials, and nanoelectronics. This publication summarizes the presentations and discussions from the workshop. Table of Contents Front Matter Overview 1 Ultra-Strong Molecules 2 High-Entropy Materials 3 Nanoelectronics References Appendixes Appendix A: Workshop Statement of Task Appendix B: Registered WorkshopParticipants Appendix C: Workshop Agenda Appendix D: Acronyms

Established in December 2016, the National Academies of Sciences, Engineering, and Medicine's Roundtable on Data Science Postsecondary Education was charged with identifying the challenges of and highlighting best practices in postsecondary data science education. Convening quarterly for 3 years, representatives from academia, industry, and government gathered with other experts from across the nation to discuss various topics under this charge. The meetings centered on four central themes: foundations of data science; data science across the postsecondary curriculum; data science across society; and ethics and data science. This publication highlights the presentations and discussions of each meeting. Table of Contents Front Matter 1 Introduction 2 Meeting #1: The Foundations of Data Science from Statistics, Computer Science, Mathematics, and Engineering 3 Meeting #2: Examining the Intersection of Domain Expertise and Data Science 4 Meeting #3: Data Science Education in the Workplace 5 Meeting #4: Alternative Mechanisms for Data Science Education 6 Meeting #5: Integrating Ethical and Privacy Concerns into Data Science Education 7 Meeting #6: Improving Reproducibility by Teaching Data Science as a Scientific Process 8 Meeting #7: Programs and Approaches for Data Science Education at the Ph.D. Level 9 Meeting #8: Challenges and Opportunities to Better Engage Women and Minorities in Data Science Education 10 Meeting #9: Motivating Data Science Education Through Social Good 11 Meeting #10: Improving Coordination Between Academia and Industry 12 Meeting #11: Data Science Education at Two-Year Colleges References Appendixes Appendix A: Biographical Sketches of Roundtable Members Appendix B: Meeting Participants

On January 30-31, 2019 the Board on Mathematical Sciences and Analytics, in collaboration with the Board on Energy and Environmental Systems and the Computer Science and Telecommunications Board, convened a workshop in Washington, D.C. to explore the frontiers of mathematics and data science needs for sustainable urban communities. The workshop strengthened the emerging interdisciplinary network of practitioners, business leaders, government officials, nonprofit stakeholders, academics, and policy makers using data, modeling, and simulation for urban and community sustainability, and addressed common challenges that the community faces. Presentations highlighted urban sustainability research efforts and programs under way, including research into air quality, water management, waste disposal, and social equity and discussed promising urban sustainability research questions that improved use of big data, modeling, and simulation can help address. This publication summarizes the presentation and discussion of the workshop. Table of Contents Front Matter 1 Introduction 2 Framing the Problem 3 Advances in Data, Modeling, and Simulation 4 Challenges and Opportunities for Cities 5 Identifying Directions for Partnership 6 Reflections and Next Steps References Appendixes Appendix A: Workshop Agenda Appendix B: Registered Workshop Participants Appendix C: Workshop Planning Committee Biographical Information

The Intelligence Community Studies Board of the National Academies of Sciences, Engineering, and Medicine convened a workshop on August 9-10, 2017 to examine challenges in machine generation of analytic products from multi-source data. Workshop speakers and participants discussed research challenges related to machine-based methods for generating analytic products and for automating the evaluation of these products, with special attention to learning from small data, using multi-source data, adversarial learning, and understanding the human-machine relationship. This publication summarizes the presentations and discussions from the workshop. Table of Contents Front Matter 1 Introduction 2 Session 1: Plenary 3 Session 2: Machine Learning from Image, Video, and Map Data 4 Session 3: Machine Learning from Natural Languages 5 Session 4: Learning from Multi-Source Data 6 Session 5: Learning from Noisy, Adversarial Inputs 7 Session 6: Learning from Social Media 8 Session 7: Humans and Machines Working Together with Big Data 9 Session 8: Use of Machine Learning for Privacy Ethics 10 Session 9: Evaluation of Machine-Generated Products 11 Session 10: Capability Technology Matrix Appendixes Appendix A: Biographical Sketches of Workshop Planning Committee Appendix B: Workshop Agenda Appendix C: Workshop Statement of Task Appendix D: Capability Technology Tables Appendix E: Acronyms

The Board on Science Education and the Board on Mathematical Sciences and Analytics of the National Academies of Sciences, Engineering, and Medicine convened the Workshop on Increasing Student Success in Developmental Mathematics on March 18-19, 2019. The Workshop explored how to best support all students in postsecondary mathematics, with particular attention to students who are unsuccessful in developmental mathematics and with an eye toward issues of access to promising reforms and equitable learning environments. The two-day workshop was designed to bring together a variety of stakeholders, including experts who have developed and/or implemented new initiatives to improve the mathematics education experience for students. The overarching goal of the workshop was to take stock of the mathematics education community's progress in this domain. Participants examined the data on students who are well-served by new reform structures in developmental mathematics and discussed various cohorts of students who are not currently well served - those who even with access to reforms do not succeed and those who do not have access to a reform due to differential access constraints. Throughout the workshop, participants also explored promising approaches to bolstering student outcomes in mathematics, focusing especially on research and data that demonstrate the success of these approaches; deliberated and discussed barriers and opportunities for effectively serving all students; and outlined some key directions of inquiry intended to address the prevailing research and data needs in the field. This publication summarizes the presentations and discussion of the workshop. Table of Contents Front Matter 1 Introduction 2 The Current Landscape of Developmental Mathematics Education 3 Developmental Mathematics Students and Their Experiences 4 Promising Approaches for Transforming Developmental Mathematics Education 5 Building Capacity to Meet the Needs of Students 6 Vision for the Future and Possible Next Steps References Appendix A: Workshop Agenda Appendix B: Biographical Sketches of Workshop Planning Committee Members and Presenters Appendix C: Workshop Participants